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Summary 



A study is reported in which a number -of users^ of differing 
bapkgrpund and experience^, recorded the j^ifocedure used in 
making searches of the subject ind^^ t6^ iSci'^nce Abstracts • 
The procedures are discussed and conciusions drayn whidh are 
compared with the results of p^railel INSPSG stUdlies on user 
preference in subject indexes* 
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Introduction 




This study is one of a series of user studies carried out 
- by INSPEC. In these studies, the user^s jpreferences for 
various subject index formats and characteristics were 
sought and their use and opinions of Science Abstracts, 
in particular, were examined. 




In the first studies, users were asked if they found 

particular characteristics of various indexes acceptable - 

or useful, and to give a general indication of how they 

make a search in the indexes to Science Ab3tracJ;si Pdr 

example, they were askeid if they made use/of the cross- ^ 

references provided. | 




These were essentially subjective assessments, '"whereas 
in the study repor.ted here, a more objective evaluation 
was sought. The object of the sti^dy was tp record detailed 
descrii>tions of the procedure , employed in a rijimber of 
actual searches of the indexes to iScience: Absltracts. J]^^ ' 
these data, any problemi which the usf5rst encounter wdul^^^ 
be shoWh and any areas in which the indexes^^ better 
' * structiired to suit the u^ers ? re<iux^ 
in|^hed;\ 


: 


DiWerent users follow different search procedures^ a^ 
their search requirements are as diverse as the 13? /varied 
degrees of subject knowledge^ experience and familiarity 
with the indexes. It was, therefore, jpilaimed that the 
dQcumented searches should be made by both scientists and 
librarians f by users familiar with the indexes and by 
first- time users. Varying degrees of exhaustiyity of 
search, output requiremeixts and other variables were to 
be included if at all possible. 


• 


Collection of Data * 


- 


A detailed description of a search may be recorded either 
by the user himself or by an observer. The latter approach 
has two particular disadvantages: Firstly, the searcher is 
easily influenced in the way he carries out his search 
because he is being watched, and will tend to act in the 
wa:y he considers is expected of him; secondly, this method 
of data collection is time-consuming. Not only must the 
observer be present throughout the entire search, but must 
also be available close to the indexes for I'^hg periods of 
time in order that he is present when a us. arrives, since 
the search must be carried out in the user* s .time and not 
• at the convenience of the project staff. It was essentially 
' for this latter reason that this means of data collection 
was rejected. 




The alternative- to ask the user to record his own search 
-also has its problems. This is still an important factor. 

r 
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The time taken for a search is considerably extended if 
all the decisions made and headings and index^ strings 
consulted are recorded^ -Additionallyy in order that the 
search can be reconstxnictedi the user must bo prompted to 
record certain essential details » but this must be ;done 
in such' a way that the user is not lhfluenc(ed in the 
manner in vhi6h he carries 'out the search* ^ For instance, 
if a' user is asked if he consulted tlie cr6ss«ref ereiices , 
he may feel that he ought to do so even if) it is riot his 
nox*mal practice. Despite these dif f icuities , this pro- 
cedure for collecting the data was addicted because it -was 
most suited to the time and number of project staff 
available • . . ^ 

r 

A number of formats of a record sheet for use by searchers 
were ^es^;ed to ensure that sufficient details were recorded 
for the search/ to be reconstructed* The final fpXTttat is 
shown in Appendix li / ^ . 

A number of subscribers were invited to par^i'cipk^ iri: 
the ^project by the/ letter s^^ 
askecL^tb encourage their users, to cc^^^ 
search record sheets if they used/tHe ihd^^ 
complete one themselves if the occassion arose i ^1^^ 
scribers who were approached were sympathetic towards the*^ 
project arid volunteered to help if it was possible f or . 
them to do so. As was anticipated, they qualified their 
offers by explaining that most of their use of the ±ndexes » 
was under gi^ai; pressure of ^time arid iirider these circum- 
stances it would not be possible to complete a record sheet* 
They also thought that some of the searches which they made 
would not be suitable for the. project, although it was 
explained that the study sought to investigate any use made 
of the indexes* 

Despite the initial willingness of the subscribers to 
particii)ate, this procedure ^did not prove to be satisfactory. 
The Library of the Institution .of Electrical Engineers was 
one of the part icii>atirig libraries and this was the single 
source^ of useful data* Again, their main probiem was 
of contacting readers before they started a search in the 
indexes* The librarian did not have the opportunity to ask 
every user to complete the record sheet and so the project 
staff spent considerable tim^ near the indexes in order to 
make contact with anyone who used them* 



Search Procedure and User Preference 

As a result of the problems encountered in collecting data, 
insufficient record sheets were completed for any statistical 
analysis to be made of the data* However, the record sheets 
completed may be treated as case studies representing 
searches made by users with differing backgrounds* These 

i 
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were two information officers, familiar with theindexes 

and qualified in the subject, a librarian, unfamiliar J^^^ 

the indexes and subject matter, arid two scienfis ts,"^ one ^^^^ 

of whom used' the indexes from time to tinie iand the otlier 

who had hot used them before., 

The five case studies are summarised in Appendix 3 i?^ which 
particular points about the Way in which each search was 
carried out are rioted* Compalrispri of the searches ^ one , 
with another, and with the user preference observed, in 
the earlier studies is of interest • 

. Subject Index Headings 

Injevery instance, the soarcher looked first for the corir 

cepts in which he expressed his query as ;Sub 

headings. These concepts Wei:© frequen^^^ spepif^i " 

geh^rklly comprised more tham- one-.t^ 

inte^f.ei'ehce^^^^ Scf e^ntists and' ifif qrm^ 

aliki) ^n- tHis t endaftcy ^ Ey|n;>^^ anl^bOT of fit 

ira:5 famiii^^ tfae speciHty o^^^ 

appe^rs^, to have been- made to look for :,su^^ Subject 
headihgs which miglit be present. Only wheii t^e specific 
concepts were not located, did the searchers move to the 
mor^ .generic headings. These were usually one of the 
terms of the multi-word concept originally soughti Prom 
these case studies i it would seem that tiie user expects a high 
preco-ordiriation of index teims . This then ^is the 
explanation for the strong preference for British Technology 
Inde3t> which was shown in the previous user studies since 
British Technology Index has a high preco-brdiriation of index 
terms* j ' 

Only the information officers thought for themselves of 
possible alternatives subject headings* Even where the 
first headings found were not. very productive, the other 
users were either unable to think of alternative headings 
or were not prepared to-do so* .This would indicate that a 
lead-in vocabulary is required which is large enough for 
it to be generally tmnecessaiy for the user to make the 
jump from the vocabulary of his query to that of the subject 
index headings* 



Cross-references ^ 

In support of the results obtained from the previous studies, 
these case studies indicate that only the information officers 
and librarians make use of the cross-references at present 
provided in the indexes* However, it is not possible to 
determine from the search records whether the user was 
sufficiently satisfied with the headings already located or 
whether he would not use the cross-references in any case* 



For "the same reason, it is not possible to determine 
whether the search would have been more successful had 
the cross-referenced headings be'en^ colsulted* The earlier 
studies would indicate that the users airef-* satisfied that , 
sufficient cross-references are* already Included* 

Allied to the question os lisage of cross-rejCereiices , it 
can be seen that the libi^ariaLhs and information officers 
carry out niore exhaustive searches th&i, the. scien^^ 
For the librarian new to the indexes;, this represents 
an effort to become familiar with. itV stinicture and iiPdr the 
experienced infoiination officer ah awa|.reness' -of the falli- 
bility of indexing* More generally, it i^^ a different 
seardh requireraeifit. The infoiroation wo^ 

proxy, was looking for ten to twenty items wliil.e the scientist 

was satisfied* wit^ fewer* Possibly th^ scieriti^ 

clearer def! initipn of what he requi^^ whi^ie tlite information 

officer, less; sure of hrs. request 

item^^ the refqu^^^ miQce' t^^ 

meniVpf use • : 

Gold ./Pages , - 

Although users do not think of alternative headings for 
themselves, neither do they often use the gold pages to 
suggest any* Previous discussion indicates that the 
scientists do not geheraMy see any heed for further headings^ 
but the same would hot be said pi* the information ojTf icers 
and iibrarisms because they use the cross-references* For 
the librarian with no subject knowledjge^ tool is , 

probably not suitably structured, and for them the classi- 
fied arrangement might usefully be replabed by an alphabeti- 
cally arranged lead-in vocabulary* 



The New User to the Index * 

Despite the reference made above to the infrequent use of - 
the gold pages by scientists^ the only user in this study 
to use them was the scientist who had hot used the indexes * 
before* To him the classified arrangement was meaningful 
and although the headings available were not directly suited 
to his particular interests, he did hot tibiink this was a 
serious disadvantage when the subject breakdown was logical* 
He showed an encouraging desire to learn to use the indexes 
effectively, but was thwarted in this because he was unable 
to locate a sufficiently comprehensive explanation* 



Index Entries 

The keywords of the index entries were used for selection 
purposes, but only in a few of the searches was the alpha- 
betical arrangement of the keywords utilized* This approach 
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is not suitable in all instances* For example » ±£ informa- 
tion on new materials used in fuel cells is requiredi the 
searcher nr.ust necessarily scan the comj^lete list because * 
he does not know what the new materials will be« ' If the 
exact requirement of a search is not knoinii ^the alphabetical 
arrangement cannot be used* This fact presents an impor- 
tant ^argument against the vietw put fonmrd in the study of 
user^ preference! that the large number of entries which 
would result from the introduction of multiple entries for 
each item under a single heading is acceptable because the 
keywords are alphabetically arranged. Some searchers must 
of necessity scan the complete list of entries* . 



Treatment Codes 

During the course of correspondence with bhe of the parti- 
cipants in which he of f ered a number of opinions on his * 
requirements for indexes, he poirfted 6u?t heed for treat-, 
ment codes in the index enjtrl^es* This suggest iozv was made 
in the study of usor preference aiid is 
in that report, but this user gave a new^ ?4^l^?* 
requirement. He pointed out that he .frequ^^^ a need 

to locate dbcnmentatidh bf parti cular^^^ These are 

often tb be found in books which are dndexed ;as a single 
entry and the cbhtent of smaller sjectiohs of the book is 
not represented in the indexing terms it is assigned^ 
References to these sections of books he more usually 
-^traces through review papers and wbuld therefore find it 
helpful if review papers were always indicated as such. 



Two-stage Indexes 

Scierice Abstracts is a two-stage index. That is, the 
abstract is separate from its subject index entiy imd is 
located by an identification (abstract) number. In all these 
case studies the two steps were distinct, i.e. a complete 
list of abstract numbers was selected before any abstracts 
were consulted* It is undoubtedly inconvenient to move 
continuously between the index and abstracts, but the search 
method observed would indicate a certain confidence in the 
index entries. 

Conclusions 

Although the methodology of this study proved difficult to 
implement because it was highly demanding of time, a numl^er 
of case studies were completed. The difference in the way 
the searches were carried. out corresponded with the back- 
ground and experience of the searchers and substantiated many 
of the points which arose in previous studies of user 
preference for various^ index characteristics. 



Appendix 1 



Use of Subject Indexes to Science . 
Abstracts 



As part of our investigation of the use and, performance of 
INSPEC printed indexes we are making some detailed studies 
of individual subject searches* We would be gratefiii ,if 
you would assist us by completi ng thi s questibnhaire;^while 
you are making your next search in the subject indexes of 
Science Abstracts. Any details of this search which you 
give will be treated in confidence. 

1. How frequently do you consult the subject indexes in 
Science^ Abstracts. 



2. What is the subject of the dnf ormatioh you hope to obtain 
from the index on this occasion? Please explain as fully 
as possible. 



3« Have you consulted the index on this topic befox*e? 



4. What limilatiqns, if any, will bo imposed on the time 

you will spend on your search or the number of relevant 
items you require? 



5. What suitable subject headings would you. hope to find 
in the index for use in this search? 



6* As you use each index» please list every subject 

heading vhich you consult, and list the abstract numbers 
of these entries vhose abstracts you intend to consult* ^ 



Science 
Abstracts 
Series 
A, B or C 



Volume 



Part 



Subject headings 
consulted ^ 



Abstracts 
Numbers 



I 

I 

I- 

I 



I 



7« Did you follow up any of the cross references supplied? 



8* Did you oake use of the classified list of subj^ec* 
headings (gold pages)? 



9* Did you refer to the abstracts before your search of the 
index was completed? 



10. Did you nake any use of the chapter arrangement of the 
abstracts journal is^..your search? 



11* Pleai^e indicate by a tick^ or in some other vayi those 
abstracts^ listed in Question 6 which were relevaiit^ 



12 • If you modified your initial requirements during your 
searchi please explain how* 



ERIC 



13. Approximately how long did. your search in Science 
Abstracts take you? 



l4. Please explain any difficulties which you may have 
encountered during your search* 



Date 



Signed 



We are most grateful for your help* 

Please return the form to: 
INSPEC 

The Instlttktion of Electrical Engineers 
Savoy Place 
London WC2R OBL 



- 9 - 




Appendix 2 




1 WCSli ML t*i: 01-240 1871 - Tatex 261176 . 

Grams: Voltampert London Toim- Cables: Voltampora London WC2 



September 1971 



Dear / . . - ' 

We aik carrying but a-series of OSTI-supported studies of 
the use and perf ormance o^ the printed indexes to-Science 
Abstracts. In the first part of ^:his investigation we 
obtained genex^ comments frpni a large number of user^ on 
the perfomKmce of the indexes, suitability of subject 
headings, layout etc. 

Ve would now like to have some detailed descriptions of 

specific searches which aupe made in our indexes, and 

would appreciate your help in this part of our invest xgatxcn. 

A number of forms are enclosed. These we would like you, 
or any other user of Science Abstracts/ to complete the 
next time a search in the indexes is made. We would prefer 
that you should complete the foirm at the time of your next 
search even though the search may not s>em altogether , 
suitable for this purposei If you are willing to complete 
more than one forin this wouldf of course, be most useful. 

¥e would be most gi^teful if you would help us in this study, 
but if you are unable to do so perhaps you would let us 
know. 

Yours sincerely. 



A.M. Hall (Miss) 
Infotmation Research Officer 



» i Encs*. 
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At>pendix 3-1 



Search Record Smnmary 

1* Case !• 

2* Information Officer 

3. Experienced user, qualified in svbject. 

k. Question: The latest material used in fuel cells. 

5« Search requirements: 10-20 references. 

6. Volumes searched: Science Abstracts B 1970 part !!• 

7. Terra initially sought: Fuel cells. 

8. Headings sought: Fuel Cells. 

o. Use of «see also* references if available : Not Available 

10. Method of scanning inde: ...uries: Scanned complete list 

11. Use of gold pages: No. 

12. Use of chapter arrangement (not specific to this search): 

13. Number of useful items retrieved: 15* 
ik. Time taken: 30 minutes. 



Appendix 3^2 



Search Record Summary 



!• Case II 

2. ^ Information Officer 

J. Experienced user, qualified in subject 

k. Question: Opi;ical/infrared communication systems and 
equipment includihg GaAs diodes,, etc. 

5. » Search requirements: Approximately 12 recent articles , 

(from the lets t fi^e years) at an 
ihtroducto^ (i^^i degree) level 
. and in English. 

6. Volumes searched : ' Science Abstra^^^ 

1976 ^art I aM^ 

7. Term initially sought: Infrared detectors. 

8. Headings used: infrared detectors^ infrared imaging, 

semiconductor diodes ^ optical cufflimmi«* 
cation equipment, optical links, laser 
beam applications^ photo diodes. 

9. Use of *see also* rieferences if available: X^s 

10. Method of scanning index entries: Scanned complete list. 

11. Use of gold pages: No 

12. Use of chapter arrangement (not specific to this search): 

13. Number of useful items retrieved: 5 , ^ 
ik. Time taken: 30 minutes. 



r 



Appendix 3-3 



Search Record Smmnary 

!• Case III 
Zm Librarian 
; 3. Unfamiliar vith the indexes 

^ 4. Question: Magnetic flux distribution in type II 

superconductors 

5. Search requirements ^ 

I 6. Volumes searched: Science Abstracts B 1970 part I 

\ 7. Term initially sought: Magnetic flux 

r 8. Headings used: Magnetic fliix measurement, magnetic fie lds, 

superconductivity, superconducting mat^tt^t^** 
superconducting magnets* 

9« Use of «see also^ references* if available: Yes 

10* Method of scanning index entries: Scanned complete list 
i and selected entries containing the question terms < 

; 11. Use ^f gold pages: No 

12t Use of chapter arrangement (not specific to this search): 
\ Not known 

13. Number of useful items retrieved: 5 

14. Time taken: not known. 
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Appendix 

Search Record Smnmary 

1# Case IV 
2« Scientist 

3» previous use of the index 

4» Question: Man-made radio noise interference • not 
interference from stars or lightening* 

5# Search requirement: Exhaustive search (or imtil he gives up) 

6. Volumes searched: Science Abstracts B 1971 Parts I and II 

1970 Part II 

7# Term initially sought :. Radio noise interference 

8# Headings used: Interference, interference/ suppresioh, 
J noise rejected after looking itt a few entries 

10« Method of scanning index entries: Scanned complete list 

11. Use of gold pages: No * 

12 • Use of chapter arrangement (not specific to this search): 

Not known 

13# Number of useful items retrieved: 7 
ik. Time taken: not known 



Appendix 3'«5 
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Search Record Suimnaiy 

!• Case V t 
2* Scientist 

3* Unfamiliar with the, indexes _ 

4# Question: Superconductivity and airgap insulation vork 
and leading personnel in Eastern EMrcpe 

5» Search requirements: - 

6« Volumes searched: Science Abstracts B 1970 Parts I and II 

7« Terms originally sought: Superb onductivity^ superconducting 

materials 

8« Headings used: Super conductivity, superconducting materials* 

9» Use of •see also* references if available : Not available 

10* Method of scanning index entrira: Scanned complete list 

11 • Use of Gold Pages: Yes 

12* Use of chapter arrangement (not specific to this search): Yes 

13* Number of useful items retrieved: Not known - 

Ik. Time Taken : Not known ^ 
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